False Discovery Rate Controlled Heterogeneous Treatment Effect Detection for Online Controlled Experiments

Online controlled experiments (a.k.a. A/B testing) have been used as the mantra for data-driven decision making on feature changing and product shipping in many Internet companies. However, it is still a great challenge to systematically measure how every code or feature change impacts millions of users with great heterogeneity (e.g. countries, ages, devices). The most commonly used A/B testing framework in many companies is based on Average Treatment Effect (ATE), which cannot detect the heterogeneity of treatment effect on users with different characteristics. In this paper, we propose statistical methods that can systematically and accurately identify Heterogeneous Treatment Effect (HTE) of any user cohort of interest (e.g. mobile device type, country), and determine which factors (e.g. age, gender) of users contribute to the heterogeneity of the treatment effect in an A/B test. By applying these methods on both simulation data and real-world experimentation data, we show how they work robustly with controlled low False Discover Rate (FDR), and at the same time, provides us with useful insights about the heterogeneity of identified user groups. We have deployed a toolkit based on these methods, and have used it to measure the Heterogeneous Treatment Effect of many A/B tests at Snap

Huber's theorem for manifolds with Ln2L^\frac{n}{2} integrable Ricci curvatures

In this paper, we generalize Huber's finite point conformal compactification theorem to a higher dimensional manifold, which is conformally compact with $L^\frac{n}{2}$ integrable Ricci curvatures.Comment: To appear in Trans. Amer. Math. So

A Study on Brand Personality of Coastal Tourism Destinations: Text Mining Approach

As the core element of the brand, brand personality is closely related to the personality of tourists. Unique and distinctive brand personality has become an important means for tourism destinations to enhance their core competitiveness. Through text analysis, the content of the online review content of three coastal tourist destinations in Yalong Bay, Silver Beach, and Gulangyu Islet were analyzed. The brand personality of coastal tourist destinations was identified from the perspective of tourist perception, and the selected 3 coastal tourist destinations were identified by correspondence analysis. Comparative analysis on a case-by-case basis.The research results show that the brand personality of coastal tourism destinations perceived by tourists is mainly concentrated in the two dimensions of “elegance” and “benevolence”, but different coastal tourism destinations have their own distinct and unique brand personalities. On this basis, directional suggestions for the development of brand personality in coastal tourism destinations are given

Research on the Optimization and Upgrading of Marine Tourism Products in Shanghai

The ocean has become a new theme of the world economic competition. The development of marine industry is an inevitable measure to stabilize the sustainable and healthy development of China’s national economy. As a leading industry of marine economy, marine tourism has great potential for development.Marine tourism products are the foundation and power source of marine tourism development. The optimization of tourism products plays the most direct and key role in the upgrading of tourism industry. Shanghai, located in the center of Yangtze River Delta, is one of the most developed regions in China. However, with the increasing competition in the tourism market, the development of marine tourism is inevitable.This paper analyzes the general situation of marine tourism resources and the development status of tourism products in Shanghai, and probes into the specific countermeasures for the upgrading of its products, so as to promote the high-efficiency development of marine economy in Shanghai